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Abstract 

We present a certified version of the Natural-Norm Successive Constraint 
Method (cNNSCM) for fast and accurate Inf-Sup lower bound evaluation of 
parametric operators. Successive Constraint Methods (SCM) are essential 
tools for the construction of a lower bound for the inf-sup stability constants 
which are required in a posteriori error analysis of reduced basis approxima¬ 
tions. They utilize a Linear Program (LP) relaxation scheme incorporating 
continuity and stability constraints. The natural-norm approach linearizes 
inf-sup constant as a function of the parameter. The Natural-Norm Suc¬ 
cessive Constraint Method (NNSCM) combines these two aspects. It uses a 
greedy algorithm to select SCM control points which adaptively construct an 
optimal decomposition of the parameter domain, and then apply the SCM 
on each domain. 

Unfortunately, the NNSCM produces no guarantee for the quality of the 
lower bound. The new cNNSCM provides an upper bound in addition to 
the lower bound and let the user control the gap, thus the quality of the 
lower bound. The efficacy and accuracy of the new method is validated by 
numerical experiments. 
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1. Introduction 


For affinely parametrized partial differential equations, the certified re¬ 
duced basis method (RBM) [TSl UHl 1201 E] utilizes an Offline-Online compu¬ 
tational decomposition strategy to produce surrogate solution (of dimension 
N) in a time that is of orders of magnitude shorter than what is needed by 
the underlying numerical solver of dimension A/" 3> iV (called truth solver 
hereafter). The RBM relies on a projection onto a low dimensional space 
spanned by truth approximations at an optimally sampled set of parame¬ 
ter values 121 El DEI [13 [13]. This low-dimensional manifold is generated by 
a greedy algorithm making use of a rigorous a posteriori error bounds for 
the held variable and associated functional outputs of interest which also 
guarantees the hdelity of the surrogate solution in approximating the truth 
approximation. The high efficiency and accuracy of RBM render it an ideal 
candidate for practical methods in the real-time and many-query contexts. 

This crucial a posteriori error bound is residual-based and requires an esti¬ 
mate (lower bound) for the stability factor of the discrete partial differential 
operator, that is the coercivity or inf-sup constant. In the RBM context, 
given any parameter value this stability factor must be estimated efficiently. 
So it should also admit an Offline-Online structure for which the Online ex¬ 
pense is independent of M. Moreover, the optimality of the low-dimensional 
RB manifold is dependent on the quality of this estimate as a parameter- 
dependent function, so the lower bound should not be too pessimistic. There 
are several approaches in the literature. A Successive Constraint Method 
(SCM) is proposed in [TT] and subsequently improved in [H El [231 [23] • R is 
a framework incorporating both continuity and stability information whose 
Online component is the resolution of a small-size Liner Programming (LP) 
problem. Hence, this procedure is rather efficient. However, the classical 
inf-sup formulation has couple of undesirable attributes - a Q^-term affine 
parameter expansion (resulting from a squaring of the operator), and loss 
of (even local) concavity. On the other hand, a “natural-norm” method 
is proposed in [6l El]. Its linearized-in-parameter inf-sup formulation has 
several desirable approximation properties - a Q-term affine parameter ex¬ 
pansion, and first order (in parameter) concavity; however, the lower bound 
procedure is rather crude - a framework which incorporates only continuity 
information. A natural-norm SCM approach is proposed in HD] combining 
the “linearized” inf-sup statement with the SCM lower bound procedure. 
The former (natural-norm) provides a smaller optimization problem which 
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enjoys intrinsic lower bound properties. The latter (SCM) provides a sys¬ 
tematic optimization framework: a Linear Program relaxation which readily 
incorporates effective stability constraints. The natural-norm SCM performs 
very well in particular in the Offline stage: it is typically an order of magni¬ 
tude less costly than either the natural-norm or “classical” SCM approaches 
alone. However, unlike the classical SCM, it provides no upper-bound thus 
no control of the quality of the lower bound. This often results in extremely 
pessimistic estimate. 

In this paper, we propose a certihed version of the NNSCM (cNNSCM). 
Without signihcantly degrading the efficiency, it provides an upper-bound 
and thus a mechanism for the user to easily control the quality of the lower 
bound. As a result, the lower bound of the new cNNSCM may be orders of 
magnitude more accurate than the original NNSCM. The method is tested 
on two elliptic partial differential equations. In what follows, we use the same 
notation as in [10] and denote the classical SCM method [II1I11|5| as SCM^ in 
order to differentiate it from the new natural-norm type of approaches. Here, 
the (squared) superscript suggests the undesired Q^-term affine parameter 
expansion in the classical method. 

This paper is organized as follows. In Section [^ we review the back¬ 
ground materials including the RBM, its A Posteriori error estimation and 
the involved stability constant. Section describes the natural-norm SCM. 
The new certihed NNSCM is proposed in Section Numerical validations 
are presented in Section and hnally some concluding remarks are offered 
in Section [6l 

2. Background 

For the completeness of this paper and to put the concerned method into 
context, we introduce the necessary background materials in this section. 
To that end, this section covers the truth solver and the related stability 
constants, the reduced basis method, and the A Posteriori error estimate 
needed therein. 

2.1. Notations 

We use n C M”' (n = 2 or 3) to denote a bounded physical domain with 
boundary dfl. We introduce a closed parameter domain P> G a point 
(F-tuple) in which is denoted n = (pi ,..., fip). A set of parameter values 
will be differentiated by superscripts Let us then dehne the Hilbert 
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space X equipped with inner product (•, ■)x and induced norm || ■ ||x- Here 
(i7o(H))^ C X C (V = 1 for a scalar field and V > 1 for a vector 

field) [m H]. Finally, we introduce a parametrized bilinear form and two 
linear forms. a(-, ■; m)- df x X —)■ M is such that 

• it is inf-sup stable and continuous over X: (3{i-i) > 0 and 7 (^ 4 ) is hnite 
W/J, G V, where 




inf sup 

v(zx 


a{w, v] 

|w|U llt’llx 


a{w,v-^i) 

and 7 (a^) = sup sup - 7 ^—^—n— 77 —; 

w&Xv&X ||'iy||v IpIIx 


Q 

• a is “affine” in the parameter: a{w,v,fi) = y~~^0g(^)ag(w, v). 

q=l 

We emphasize that it can be approximated by affine (bi)linear forms when 
it is nonaffine Pi. Finally, we introduce two linear bounded functionals 
/(•; : X —)■ M and £(■; ^) : X —)• M that are also affine in the parameter. 
The following continuous problem is then well-dehned. 

(Pc) Given fiEV, hnd G X such that a{u{i-i), v; /.i) = f{v,i-i),\/v G 
X. 

For many applications, we concern a scalar quantify of interest as s{ij,) = 
, i-i). To discretize this problem, we consider for an example a hnite 
element approximation space (of dimension A/") X^ C X. Suppose that the 
discretized bilinear form remains inf-sup stable (and continuous) over X^ 
with constants /3'^(^) > 0 and being hnite G V, where 


= inf sup 


a^[w, V] n) 


and = sup sup 


a^{w, V] n) 


&X^ y^X-X ll'W^llxx' 1111 


vexxvexJ^ ll'^llx^ ITIIx^ 


We now introduce our truth discretization: 

(Pd) Given ^ G "D, hnd u^{n) G X^ such that a{u^(fi), v; fi) = 
f{v,n),\/v G X^. 

This discretization is called truth and its solution truth approximation 
because our reduced basis approximation is built upon, and its error mea¬ 
sured with respect to this hnite element solution. The (numerical) output is 
evaluated accordingly s^{pi) = fx). Since we are essentially aban¬ 

doning (Pc), for brevity of exposition we may omit the W when there is no 
confusion. 
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We end this section by re-writing the inf-sup constant To that end, 

we hrst dehne the supremizing operator : X ^ X such that {T'^w, v)x = 
a{w,v; G X. Clearly, we have 

mn a(w,v;i-l) IIP, n/ \ ■ r 

I = argsup —-— -, and that furthermore piu.) = inf —— -. 

v&X llt^lU “-ex ll^llx 

Recalling the affine assumption allows us to decompose as 

Q 

9=1 

where (TqW,v)x = ag{w,v),\/v E X, 1 < q < Q. 

2.2. Reduced Basis Method and the A Posteriori Error Estimators 

The fundamental observation utilized by RBM is that residing 

on Ad = {u^{n), n G V} can typically be well approximated by a hnite- 
dimensional space. The RBM idea is then to propose an approximation of 
Ai by 

= span{M^(Ai^), ..., 

where, ..., are N (<^ M) truth approximations correspond¬ 

ing to the parameters ..., selected according to a judicious sampling 
strategy [IS]. For a given we now solve in for the reduced solution 

(Pr) Given G T>, hnd G such that a{u^fi) = 

f{v),Wv G W^. 

The online computation is A/'-independent, thanks to the assumption that 
the (bi)hnear forms are affine. Hence, the online part is very efficient. In 
order to be able to “optimally” hnd the N parameters and to assure the 
hdelity of the reduced basis solution u^{i-i) to approximate the truth solution 
we need the a posteriori error estimator [I2l HH [IH EHl El] 

that involves the residual 

r{v, n) = f^{v; n) - a^{u^{n),v; fi) 

and the inf-sup stability constant With this estimator, we can de¬ 

scribe briehy the classical greedy algorithm used to hnd the N parameters 
Hq ,..., and the space W^: We hrst randomly select one parameter value 
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and compute the associated truth approximation. Next, we scan the entire 
discrete parameter space and for each parameter in this space compute its 
RB approximation and the error estimator Ai(^i). The next parameter 
value we select, 112 , is the one corresponding to the largest error estimator. 
We then compute the truth approximation and thus have a new basis set 
consisting of two elements. This process is repeated until the maximum of 
the error estimators is sufficiently small. 

We end by providing the missing component - how the inf-sup lower 
bound will serve within the error estimators. The reduced basis field error 
and output error (relative to the truth discretization) satisfies [ISl El] 

• < ^n(p), where Af,(p) = ■ 

. - Mp)\ < where A‘M = , 

Here, || ■ ||x' refers to the dual norm with respect to and is a lower 
bound of The later implies that the quality of the inf-sup lower 

bound affects the quality of the error bound which, in turn, determines the 
optimality of the RB space . How to build a high-quality (3^^ efficiently 
is the topic of the next section. 

3. Natural-Norm SCM Lower Bound 

The NNSCM [TU] constructs a decomposition of the (global) parameter 
domain 

by a greedy approach. There is a “control point” within each subdomain. 
Locally in each subdomain, a linearized-in-parameter inf-sup formulation is 
utilized incorporating continuity information resulting in first order (in pa¬ 
rameter) concavity. For the completeness of this paper and, in addition, due 
to that many ingredients of the NNSCM are adopted by our new cNNSCM, 
we detail the local and global aspects of this algorithm in the following two 
subsections respectively . 

3.1. Local Approximation 

The inf-sup numbers at the control points of these subdomains {/9'^(A^)}fcLi 
are calculated exactly and, at any other location, the ratio is approxi¬ 

mated from below. Obviously the product of this lower bound and [jiA) 
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provides a lower bound for /3^{fx). Let us describe these two components 
briefly. 


3.1.1. From to f3{n) 

For a given subdomain with control point fl, and G we dehne 
an inf-sup constant measured relative to a natural-norm fIT\ : 


PM 


. a{w,v;fi) 

inf sup 11 . : 


and a lower bound for Pp.{i-i), 


PM 


. „ a(w,T>^w; fl) 

inf ;7 ^—- 

WGX WTi^wfx 


It can be easily shown that Pp.{ii) < Pp,{lJ>) and that Pp.{ii) will be a good 
approximation to Pfx{fi) for fi near fl [21]. It is also straightforward to show 
that fl{fi)pfj,{ii) < P{fi) which allows us to translate the lower bound for 
Pfiifi) into a lower bound for P{fi) given (3{fi). 

3.1.2. Reliable lower bound for through the SCM^ 

What remains of the local approximation is the application of the classical 
SCM^ to construct lower and upper bounds for Pp.{ii). This is applicable by 
simply noting that 


Q 

PM) = inf where J{y,fi) = ^QMVq 

y^yp. 


and 


yp. = {yeR^\3wyeX s.t. yq = , 1 < g < Q}- 


IjT^m 


ywx 


However, for the completeness of this algorithm, let us provide the details 
of this procedure. We hrst introduce the bounding box 


Q 




3q 


L 1 L PM P{r). 


, where = sup 


iiu™i 


X 


ex llinllx 


1 < g < Q; 
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note that the 7 ^ are independent of p,. Next, given the local SCM sample 
(whose construction, detailed in the next section, will be done in a greedy 
fashion) 

we can now dehne 

0 _ b 

= {»6 I E s 7 (a'). V e c? 

q=l 

and then the lower bound for determined by is obtained by solving 

the linear programming problem 

inf eVfi. (1) 

Here, (n) denotes the set of J'^ points that are closest to p within the 
set Cp_. To develop the upper bound, we simply introduce the set 

= { 2/^1 < j < Jfi} where y},{n) = arg mmj{y;n); 

y&yp. 

and then dehne 


/^a^(m;Ca)= inf V^gT>a- (2) 

We want to make two remarks at this point; 

• We have y^^iCp,) C yp, C 3^“(/n,C^) and hence [lO] py^{y,Cp) > 

• The lower bound will only be useful if > 0 over Vp which is, 

in general, not a consequence of > 0, G Vp. We must thus 
adaptively divide the global parameter domain V into subdomains Vp 
to ensure positivity. This is the subject of the next subsection. 

3.2. Global Approximation: Greedy Sampling Procedure 

We construct our domain decomposition V = by a greedy ap¬ 

proach. We hrst extend our lower and upper bounds of ([^ and (|^ to all 
fJL G V'. for a given pL eV and a hnite sample S gV we dehne 


and 


(m; ^) = inf J{y,fi),yneV. 
y&y]i^i£) 

This allows us to introduce an “SCMr quality control” indicator. 






Wfi e V. 


Here, the “R” in “SCMr” indicates that it is to control the ratio between 
/3(^i) and /3{p,). Finally, we require a very rich train sample S G T’, an SCM 
tolerance G (0,1), and an inf-sup tolerance function fi) > 0 which is 
usually set to zero. 

We are now ready to dehne the greedy algorithm in Algorithm The 


Algorithm 1 Natural-Norm SCM Greedy Algorithm 

1. Set S = {p,^}, k = 1] here is an arbitrary point in S; 

2. Initialize = {}, Jf^k = 0, Ufj^k = {}, = {}, and Cmax = +oo 

while 'R*p^k\'R-p.k 7^ {} or e^ax > do 

2.1. Set to be p^ if Jp^k = 0, and argmax^g= e^fc(/i; other¬ 

wise. 

2.2. Set Cpk = Cpk U TZpk = 7^1^ and TZ*^^ = {/i G S : 

9pk {^9^) C-pk^ ^ R )}”; Jfik ^ Jjik T 1; *^max (/^i ). 

if YR*-A = |S| then 

I I I I 

Break; 

end if 
end while 

3. Update (prune) S ^ E\R.pk; 
if S = {}, then 

Set K = k and terminate; 
else 

Set p^^^ = argmin^gs (7^? (/^; S = k = k + 1, and goto 

2 ; 

end if 


“output” from the greedy procedure is the set of points S = ..., p^} 

and associated SCM sample sets Cpk, 1 < k < K. Several remarks regarding 
this algorithm follow: 
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• The set of points TZ play the role of temporary subdomains during 
the greedy construction. Observe that we declare the current subdo¬ 
main/approximation complete (and move to the next subdomain) only 
when the trial sample offers no improvement in the positivity cover¬ 
age and the trial sample is not required to satisfy our SCM quality 
criterion. 

• The improvement for a particular subdomain and identihcation of a new 
subdomain are based on different criteria. For the former ep_k(fi;Cp^k) 
is very effective: the argmax will avoid /j, for which the upper bound 
is negative and hence likely to lie outside the domain of relevance of 

— /c 

, yet favor ^ for which the current approximation is poor and hence 
(likely) to lie at the extremes of the domain of relevance of - thus 
promoting optimal coverage. In contrast, for the latter is very 

effective: the arg min will look for the most negative value of the lower 

— /c 

bound - thus leaving the domain of relevance of T^. 

Finally, our global lower bound for is dehned to be the maximum of 
those translated from each subdomain: 

. max d(A^)^^?(^;C^0- (3) 

4. Certified NNSCM 

Our primary interest is in the lower bound as it is required for 

rigor in our reduced basis a posteriori error estimator. However, the upper 
bound serves an important role in making sure the lower bound is not too 
pessimistic. We note that NNSCM ng can ensure reasonable accuracy by 
choosing an appropriate fi) in Algorithm However, there are usually 
parameters in fi) that we need to tune and there is no mechanism to 
easily control the true error of the lower bound for 

Here, we develop an upper bound that can be constructed together with 
the natural-norm SCM lower bound at marginal offline cost. To do that, we 
recall that for SCM^, 




inf sup “^1“’’,!'’,^^ and nw = W e«(M)r% 

IrIIx ItIIx ^ 
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to realize 


= inf (2- 


\w\\x^f 


pGX-^ 

q' = l q"=q' 

Here, 5qiqii is the Kronecker delta. Next, we identify 

l<q' <q <Q^ l<q<Q = 


Q{Q + 1 ) 


{T'^'w, T^”w)xx + {T'^”w, T‘^'w)xx 


,l < q' < q” < Q I—)■ al^{w,v),l < q < Q, 


and obtain 


Q 




q=l 


(w, w) 

\\w\Wx 


(4) 


Having this interpretation, we simply introduce the set 

1 < j < Jf,} 

where w*Jfi^p) is such that if we define yq = for w = w*n{fi^p), 


1 < <? < Q, we have {?/i,... ,|/q} = argmin^gy^ J{y] A^)- We are now ready 
to define an upper bound for 




Q 


- a/f (w, w) 


MWx 


(5) 


The global upper bound for /3(Ai) is defined to be the minimum of (A^i A^) 
for different control points Jl\ 


( 6 ) 


and the “SCM^ quality control” of the global lower bound 

We are now ready to state the certified NNSCM, Algorithm Here we 
introduce an additional tolerance eg which is to bound e{ii) so that we have 


(1 - eg)P^^{^i) < / 3 ^^( a ^) < ( a ^) < / 5 ^^( a ^). 


.AT/ 


?UB/ 
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Algorithm 2 Certified Natural-Norm SCM Greedy Algorithm 

1. Set S = k = 1; here is an arbitrary point in S; 

2. Initialize Cp^k = {}, Jpk = 0, TZpk = {}, = {}, and e^ax = +oo 

while n*^k\llpk 7 ^ {} or e^ax > do 

2 .1. Set to be if Jpk = 0, and argmax^gs e^fe(/i; other¬ 

wise. 

2.2. Set Cpk = Cpk U TZpk = and = {p G S : 

9 ^ t)}, J^ A 1; ^max (h") )• 

if = |S| then 

Break; 
end if 
end while 

3. Update (prune) S ^ E\R.pk; 
if S = {}, then 

if e(/r, •) < eg then 

Set K = k and terminate; 
else 

Set A; = 1, S' = with = argmax^gs e(^i) and goto 2. 
end if 
else 

Set = argmin^gs C^fe), S = k = k + 1, and goto 

2; _ 

end if 


This algorithm is very similar to Algorithm [T] In addition to defining the 
global upper bound, it incorporates the mechanism of allowing for multiple 
rounds of domain decomposition which is not possible for NNSCM. In the 
context of the cNNSCM, NNSCM stops after the first round when the whole 
parameter domain is covered and, for each subdomain, the quality of the 

lower bound for the ratio has achieved the desired tolerance. On the 

/3(m) 

other hand, the cNNSCM detects this, through monitoring the quality of 
measured by -—and continue with more rounds of domain 
decomposition. For each /r G H, it is covered by one subdomain at each round 
making it possible to sharpen the lower bound in approximating 

Moreover, to start a new round, the size of e(^) is a good indicator for the 
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need of a control point. Thus we set fj} = argmax^gc to set the stage 
for the next domain decomposition. 

Another important remark is that the increase in computational cost due 
to the term expansion in Q is negligible. There is only one Q—operation 
(a Q term summation in ([^) every time there is a control point identihed 
or there is a new SCMr sample point added within a subdomain. This is 
negligible in comparison to the Q—dependent cost in SCM^ whose elimination 
is one critical contribution of NNSCM. 


5. Numerical Results 


We test our implementation of the NNSCM and cNNSCM on the following 
two test problems: 


h ^yy 'll f^ X 


U = g, 


X G Oil 


/r e P = [0.1,4] X [0,2], (7a) 


(1 T /X x)'Uxx T (1 T p y'j'^yy /*(^): 3^ G 


U = g, 


X G dfl 


^eV= [-0.99,0.1 


(7b) 


The result for the hrst problem is shown in Figure We discretize the 
parameter domain by a 129 x 65 uniform grid, and the differential operator 
by the Pseudospectral collocation method [22]. We set = 8, = 0.8 

(the later applicable to cNNSCM only). Plotted on the hrst row are /d^^(^) 
overlaid to /3^®(^). For the NNSCM, since the parameter domain T> is com¬ 
pletely decomposed and the e^-condition is met on each subdomain, it will 
stop after the hrst column. As a result, the quality of the lower bound, mea- 


sured by max ■ 


-, is bad. On the other hand, the cNNSCM 


detects this and continue with two more rounds of domain decompositions 
gradually improving the quality of the lower bound. This is clearly visible 

^UB(^) — 

on the graph and also shown by the decreasing of max -—r-. To 

M w^(m) 

take a closer look at the quality of the lower bound, we plot the histogram 

of --TgBT—r- - on the second row. It shows that the gap between the 

/?ub(^) 
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lower bound and upper bound is below the prescribed tolerance and the 
quality of the lower bound is uniformly better than that by NNSCM. 

The result for the second problem is shown in Figure The setting is 
the same other than that the parameter domain is discretized by a 65 x 65 
grid. This is a more challenging problem in the sense that it becomes close 
to being degenerate at the four corners of the parameter domain. The poor 
quality of the NNSCM lower bound is clearly shown by the picture and that 

max-—--= 0.99986 at convergence for NNSCM. The cNNSCM 

has, again, improved it with a few more rounds of decompositions resulting 
in a lower bound that is very close to the upper bound. 





Figure 1: Certified NNSCM for the first test problem. Plotted on the first row are the lower 
bounds and upper bounds (as functions of the parameter) after the 1®*, 2“'^, and 3’'*^ (final) 
round of domain decomposition. On the bottom row is the histogram of -— 

Their maximums are 0.9,0.85,0.67 from left to right. Notice that the original NNSCM 
would have stopped after the first column. 


6. Concluding remarks 

A rigorous and controllably tight lower bound for the stability parameter 
that is efficiently achievable is a critical part in the development of certihed 
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/)”"((*) /SraCc) 


Figure 2: Certified NNSCM for the second test problem. Plotted on the first row are 
the lower bounds and upper bounds (as functions of the parameter) after the 1®*, 
and 6*^ (final) round of domain decomposition. On the bottom row is the histogram of 




Their maximums are 0.99986, 0.943, 0.761 from left to right. Notice that 


/3UB(^) 

the original NNSCM would have stopped after the first column. 
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reduced basis methods for parametrized partial differential equations. The 
available methodologies either suffer from signihcant computational cost or 
inferior tightness of the bound. 

In this paper, we have improved a recent novel approach combining two 
previous techniques by adding a mechanism through which the practitioners 
can control the tightness of the lower bound. It is achieved by building simul¬ 
taneously an upper bound and shrinking the gap between the two through 
multiple domain decompositions. Numerical experiments demonstrate the 
effectiveness of the new approach and highlight its signihcant improvement 
over the Natural-Norm SCM. 
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